THE CONVEX POSITIVSTELLENSATZ IN A FREE ALGEBRA 



J. WILLIAM HELTON\ IGOR KLEP^, AND SCOTT MCCULLOUGH^ 
Abstract. Given a monic linear pencil L in g variables, let = {^L{n))nen where 

and Sfj is the set of (7-tuples of symmetric n x n matrices. Because L is a monic linear 
pencil, each '^^(n) is convex with interior, and conversely it is known that convex bounded 
noncommutative semialgebraic sets with interior are all of the form . The main result of 
this paper establishes a perfect noncommutative Nichtnegativstellensatz on a convex semial- 
gebraic set. Namely, a noncommutative matrix- valued polynomial p is positive semidefinite 
on if and only if it has a weighted sum of squares representation with optimal degree 
bounds: 

finite 

P = s*s+ ^ fjLfj, 
3 

where s, /j are matrices of noncommutative polynomials of degree no greater than ^S^eI^ 
This noncommutative result contrasts sharply with the commutative setting, where there is 
no control on the degrees of s, fj and assuming only p nonnegative, as opposed to p strictly 
positive, yields a clean Positivstellensatz so seldom that such cases are noteworthy. 



1. Introduction 

A Positivstellensatz is an algebraic certificate for a given polynomial p to have a specific 
positivity property and such theorems date back in some form for over one hundred years for 
conventional (commutative) polynomials, cf. [BCR98, LaslO, Lau09, Mar08, PDOl, Sce09]. 
Positivstellensatze for polynomials in noncommuting variables are creatures of this century - 
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see [HKM12, HM04a, KS07, PNAlO, DLTW08]; for software equipped to dealing with posi- 
tive noncommutative polynomials we refer to [HOSM+, CKPll]. Often in the noncommu- 
tative setting such theorems have cleaner statements than their commutative counterparts. 
For instance, a multivariate (commutative) polynomial on which is pointwise nonnegative 
need not be a sum of squares, but a noncommutative polynomial which is nonnegative (in a 
sense made precise below) is a sum of squares - a result of the first author [Hel02]. 

Classical commutative Positivstellensatze generally require p to be strictly positive - the 
cases where nonnegative suffices are few and noteworthy, cf. [Sce09], and the degrees of the 
polynomials appearing in the representation of p as a weighted sum of squares are typically 
very high compared to that of p. Furthermore, the semialgebraic set under consideration is 
often assumed to be bounded [SmiiQl, Put93]. 

The main result of [HM04a] gave a Positivstellensatz for matrix-valued noncommutative 
polynomials which was an exact extension, warts and all (the strict positivity assumption, 
possibility of high degree weights, and boundedness) , of the commutative Putinar Positivstel- 
lensatz [Put93]. While gratifying, it was not, as in retrospect we have come to expect in the 
free algebra setting, cleaner than its commutative counterpart. What we find in this paper 
for noncommutative polynomials is that when the underlying semialgebraic set is defined by 
a concave matrix-valued noncommutative polynomial q, a "perfect" Positivstellensatz holds; 
namely, a representation 



finite finite 



where Sj, fj are noncommutative matrix- valued polynomials of degree no greater than — 
holds for anyp which is "nonnegative" on the set where q is "nonnegative," irrespective of 
the boundedness of the semialgebraic set defined by q. Indeed this result is a Nichtnega- 
tivstellensatz, as p is only assumed to be nonnegative on ^q. Thus, compared with the main 
result of [HM04a], the hypothesis that q is concave has been added, but the boundedness (or 
archimedean) hypothesis as well as the strict positivity hypothesis have been dropped, and 
the resulting weighted sum of squares representation is improved by giving optimal degree 
bounds. As a corollary, when q = 1 and is everything, we recover the result mentioned 
in the first paragraph: nonnegative noncommutative polynomials are sums of squares. 

In the remainder of this introduction, we state our main result after providing the needed 
background and definitions. Then we give some examples. 
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1.1. Words and NC polynomials. Given positive integers n and let (M"^")^ denote 
the set of (^-tuples of real n x n matrices. A natural norm on (R'^^'^)^ is given by 

ii^f = Eii^.ir 

for X = {Xi, . . . , Xg) G (M"^")^. We use to denote real symmetric n x n matrices. 

We write (x) for the monoid freely generated by x = {xi, . . . ,Xg), i.e., (x) consists 
of words in the g noncommuting letters Xi, . . . ,Xg (including the empty word which 
plays the role of the identity). Let denote the associative M-algebra freely generated 

by X, i.e., the elements of are polynomials in the noncommuting variables x with 

coefficients in M. Its elements are called (nc) polynomials. An element of the form aw 
where 7^ a G M and w G (x) is called a monomial and a its coefficient. Hence words 
are monomials whose coefficient is 1. Endow M(x) with the natural involution * which 
fixes M U {x} pointwise, reverses the order of words, and acts linearly on polynomials. For 
example, (2 — 8x^x2X3)* = 2 — 3x3X2X^. Polynomials invariant with respect to this involution 
are symmetric. The length of the longest word in a noncommutative polynomial / G M(x) 
is the degree of / and is denoted by deg(/). The set of all words of degree at most k is 
(x)fc, and M(x)a: is the vector space of all noncommutative polynomials of degree at most k. 

Fix positive integers u and i. Matrix-valued noncommutative polynomials ele- 
ments of M^^'^(x) = M^^'' (8>IR(x); i.e., i x u matrices with entries from M(x) - will play a role 
in what follows. Elements of M^^'^(x) are conveniently represented using tensor products as 

(1) P= B^®w eR''"'{x), 

where B^^ G M.^^'^, and the sum is finite. Note that the involution * extends to matrix- valued 
polynomials by 

P* = ^B*^^w* e M'^^^(x). 

w 

If u = i and P* = P, we say P is symmetric. 

In the sequel, the tensor product will be reserved to denote the (Kronecker) tensor prod- 
uct of matrices. Thus we will omit the tensor product notation for matrix- valued polynomials 
and instead of (1) write simply 

P= J2 Bu,w eR^'^'ix). 

1.1.1. Polynomial evaluations. If p G ]R(x) is a noncommutative polynomial and X G 
(M"^")^, the evaluation p{X) G M"^" is defined in the natural way by replacing Xj by 
Xi and sending the empty word to the appropriately sized identity matrix. 
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Most of our evaluations will be on tuples of symmetric matrices X G our involution 
fixes the variables x elementwise, so only these evaluations give rise to *-representations of 
noncommutative polynomials. Polynomial evaluations extend to matrix-valued polynomials 
by evaluating entrywise. Note that if P G M.^^^{x) is symmetric, and X G S^, then P{X) G 
j^faxte jg ^ symmetric matrix. 



1.2. Linear and concave polynomials. H Ai, . . . , Ag are symmetric i x i matrices, then 



g 
a 



(2) Aa:=J2^. 



is a (homogeneous) symmetric linear matrix- valued polynomial, also called a (homoge- 
neous) linear pencil. To we associate the monic linear pencil 



I-AA = Ii-J2^. 



.jXj. 



A symmetric q G M^^^(x) is concave provided 

q{tX + (1 - t)Y) >z tq{X) + (1 - t)q{Y), < t < 1 

for all n G N and X,Y G S^. The main result in [HM04b] tells us that if q is scalar- valued 
(i.e., i = 1) and g(0) = le, then q is concave if and only if it has the form 

(3) q{x) =h- A{x) - s*{x)s{x) 

for some homogeneous linear polynomial A G and homogeneous linear vector-valued 

s G M^^^(x). This result remains true, with the obvious modifications, for q matrix- valued. 
A proof is given in Subsection 2.1. 



1.3. The Positivstellensatz. For / G M^^''(x), an element of the form /*/ G W^"" {x) 
will be called a (hermitian) square. Let TJ'' denote the cone of sums of squares oi v x v 
matrix-valued polynomials, and, given a nonnegative integer A^, let SJ^ C Y^^ denote sums 
of squares of polynomials of degree at most A^. Thus elements of have degree at most 
2A^, i.e., C {x)2n- Conversely, since the highest order terms in a sum of squares 
cannot cancel, we have W^''{x)2n n S'^ = SJ^. 
Fix a symmetric q G W'^^{x). Let 

^,(n) := {X G §^ I q{X) h 0} and % := U 

nGN 
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Given a, /3 G N, set 

finite 
i 

where a = deg(g). Obviously, if / G M^p{q) then /|fp^ ^ 0. 

We call M'^p{q) the truncated quadratic module and the noncommutative 
(nc) semialgebraic set defined by q. If q has degree one, then is also called an LMI 
(linear matrix inequality) domain. We often abbreviate M'^i^{q) to M^^. If g(0) = I {q 
is monic), then contains an nc neighborhood of 0; i.e., there exists e > such that 
for each n G N, if X G §^ and ||X|| < e, then X G ^q. Likewise ^q is called bounded 
provided there is a number R for which all X G ^q satisfy ||X|| < R. 

The following is the free convex Positivstellensatz, the main result of this paper. 

Theorem 1.1 (Convex Positivstellensatz). Suppose q G ]R^^^(x) and p G W^'^{x) are sym- 
metric matrix-valued noncommutative polynomials. 

(1) If q is concave and monic and deg(p) <2d+ 1, then 

p{X)hOforallXE^q ^ P e M,V,.(g). 

(2) If q is a monic linear pencil and deg{p) < 2d + 1, then 

p{X) yoforaiixe% ^ pe MIM- 

If, in addition, the sef^q is bounded, the right-hand side of {1) is equivalent to 

finite 

j 

while the right-hand side of (2) is equivalent to p E M^{q). 

Proof The proof of (1) and (2) is laid out in Subsection 2.3. The last fact is an immediate 
consequence of (1) and (2) and Proposition 4.2; see Subsection 4.1 for details. ■ 

Remark 1.2. It is easy to see that given /c, z/ G N there exists a positive integer t so that 
for a symmetric p G W^'^{x)k, we have p{X) >z for all X G ^q if and only if p{X) >z for 
all X G ^g(t)- The smallest such t is called the (fc, i/)-test rank of ^q. Routine arguments 
show that this {k, z/)-test rank is at most z/cr#([|]), where 

d 

a#{d) := dimM(x)rf = "^g^ 

j=0 

and [r] denotes the smallest integer not less than r. 
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There is also a bound on the number of summands in a certificate of the form p G 
^d+idi^) or p G M^^{q), coming from Caratheodory's theorem [Ba02, Theorem 1.2.3] on 
convex subsets of finite dimensional spaces. For example, in case (1) of Theorem 1.1 it is 
1 + dim (M^x'^(x)2d+i) = 1 + v^a#{2d + 1). 

Remark 1.3. The main result of [HM+] says that if q is symmetric, matrix-valued, monic, 
and the connected component, I'g, of of 

■.= [j{Xe Si I q{X) y 0} 

ngN 

is bounded and convex, then there is a monic linear pencil L such that the closure of Vq is 
of the form In particular, if is itself convex, then its closure is for some L. In 
this sense. 

Theorem 1.1 establishes a perfect Positivstellensatz on a convex no semialgebraic set. 

Remark 1.4. In [HKM+] we studied LMI domains and their inclusions. The linear Posi- 
tivstellensatz there [HKM-I-, Theorem 1.1] states the following: If q,r are two monic linear 
pencils with bounded and r is of size u x u, then C if and only if r G Mq (g). So 
this is a very special case of Theorem 1.1. Furthermore, [HKM+, Theorem 5.1] is a very 
weak form of Theorem 1.1. The techniques of proof in [IIKM+] are completely different than 
those here. We give further details and discuss the connection to complete positivity in Sub- 
section 4.1. Intriguing is the fact that the special case of Theorem 1.1 where p is affine linear 
implies a version of the Arveson Extension Theorem and the Stinespring Representation for 
matrices (as opposed to operators). 

The conclusion of Theorem 1.1 may fail if q is not assumed to be monic as the following 
examples show. 



Example 1.5. Let 



X 1 

1 



d2x2 



x)i. 



Then = 0, so p := -1 G M^''^(x)o satisfies >z 0, but -1 ^ Mq^q. However, for 

1 



u 



we have 



4 _ £ 

2 



-1 = -u*qu, 



showing that — 1 G M^. 

For details and more on the study of empty LMI domains we refer the reader to [KSll]. 
One of the main results there states that is empty (for a nonhomogeneous linear pencil 
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q) if and only if the truncated quadratic module M^^{q) (in the ring of polynomials in 
commuting variables) contains —1 for some (explicitly computable) a G N. 

Example 1.6. For another example consider 

1 X 
X 

Then = {0}. Hence obviously x ^ on But it is easy to see that x ^ Af^^^(g) for 
any G N; cf. [Zal+, Example 2]. 

1.4. Guide to the rest of the paper. Given G N, let a = deg(g) and 

K = max{2Q;, 2(3 + a}. 

In view of Theorem 1.1, we say that the truncated quadratic module M'^^i^q) has the 6- 
PosSs-property if, for a symmetric polynomial p G My^'^{x)e-, the property p{X) >z for all 
X G implies p G M'^p{q) (the converse being automatic). Note that M'^p{q) C W^'^{x)e 
and thus the definition is sensible only for 6 < k. 

The difficult part in proving Theorem 1.1 is showing that M^_^_^^{q) has the {2d + 1)- 
PosSs-property in the case that g is a monic linear pencil. The argument occupies the bulk 
of this article. The reduction to this case and other preliminaries are in the following section. 
Section 2. The passages from q linear to q concave and from M^^^ ^(g) to M^^^^q) are rather 
simple and the details are found in Subsections 2.2 and 2.3. Section 2 ends with a brief 
discussion of connections to Hankel matrices and free noncommutative moment problems. 
The proof of Theorem 1.1 culminates in Subsection 3.3, using the results on positive linear 
functionals from Subsection 2.4. 

In the last section we discuss connections to LMI domination and complete positivity 
(Subsection 4.1), and outline in Subsection 4.2 an improvement of the results of [HMP07] 
obtained by the approach here in the absence of concavity of q (or convexity of the underlying 
semialgebraic set). 



2. Reductions and preliminaries 



In this section we make first steps towards the proof of Theorem 1.1. We start by 
giving preliminaries on concave polynomials needed for two reductions in the subsequent 
subsections. 

2.1. Concave polynomials. The structure of symmetric concave matrix- valued polynomi- 
als is quite rigid. 
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Proposition 2.1. If q is a symmetric concave matrix-valued polynomial with g(0) = /, 
then there exists a homogeneous linear pencil A and a homogeneous linear matrix-valued 
polynomial s such that 

q = I - A - s*s. 

Proof. Suppose q is an i x i matrix-valued symmetric polynomial. Thus, using the tensor 
product notation, 

q = Qw<S)W, 

uiG(x) 

for some ix i matrices Qw with = Qw*. By hypothesis Q0 = g(0) = le, the ix i identity. 
Given a vector 7 G M^, the scalar- valued polynomial 

is concave. By the main result in [HM04b], q^ has degree at most two. Thus, = 
whenever w has length three or more. Hence, there is a linear pencil A and a polynomial E 
homogeneous of degree two such that 

g = /-A-S. 

Let Sjj = T^xiXj- From the concavity hypothesis, for any n, pair X,Y E S^, and 
< t < 1, 

0^+5^ ® {t^XiXj + t{l - t){XiYj + Y,Xj) + (1 - tfYiY,) 
- t Si,, ® XiXj - (1 - t) ^ Si,, ® Yu Y, 

= t{l -t)Y, ® iX^ - Y,){X^ - Y,) 

= t(l-t)S(Z), 

where Z = X — Y . It follows that for each Z G §^ we have S(Z) >z 0. Since a nonnegative 
polynomial which is homogeneous of degree two has the form s*s, for some (not necessarily 
square) homogeneous linear matrix- valued s (see e.g. [McCOl]), the conclusion follows. ■ 

2.2. Prom linear to concave. The following lemma reduces the proof of Theorem 1.1 for 
q concave to the case of q linear. 

Lemma 2.2. If M'^j^^^{q) has the {2d + l)-PosSs-property whenever q is a monic linear 
pencil, then M^_^_^^{q) has the {2d -\- l)-PosSs-property whenever q is concave and monic. 
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Proof. By Proposition 2.1, it may be assumed that q G ]R^^^(x) is described by equation (3) 
for some linear pencil E M^^^(x) and linear s E Mf'^^{x). Let 



Q 



s* I-Aa 



x) 



1- 



Hence Q is a monic linear pencil and, as is easily checked using Schur complements, = ^q. 
Thus, a given symmetric p E M^^'^ (x) is positive semidefinite on if and only if it is positive 
semidefinite on ^g. 

Let Q = LDL* be the LDU decomposition of Q, that is 



/ 

s* I 



and 



D 



I 

I-A-s*s 



By hypothesis, M^_^_^ ^{Q) has the (2(i+ l)-PosSs- property and we are to show that M]^_^^ ^(g) 
does too. To this end suppose p E M.^^'^ {x) has degree at most 2d + 1 and is positive 
semidefinite on = ^g. Hence p has a representation as 



P = G + Y.\f: 



9i 



Q 



with gj E M^^'^(x)rf, fj E W'"'{x)d and G E 

^d+i ^ of squares of matrix-valued polyno- 
mials of degree at most d+ 1. Since 



L* 














3^ 



it follows that 
(5) 



P 



Observing that fj + sgj has degree at most d+1, (5) shows that p E M^^^ ^(g) and completes 
the proof. ■ 

2.3. Prom Ma+i^d to It turns out that in the case q is monic linear, M^_^^ ^(g) has the 

(2(i + l)-PosSs-property if and only if M'^^{q) does. 



Lemma 2.3. Suppose q is a monic linear pencil. If p E 
andpE M-{q), then p E M-Jq)- 



(x) has degree at most 2d + 1 



Proof lipE M^^i^^(g) then 

for matrix- valued polynomials gj of degree at most d+1 and fj of degree at most d. Any 
degree 2d+2 terms in ^ g*gj appear as (positively weighted) squares and can not be canceled 
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by terms in ^ fjQfj, since the latter have degree at most 2d + 1. Hence each gj must have 
degree at most 2d. ■ 

By the results of Subsections 2.2 and 2.3, Theorem 1.1 follows from the following a priori 
weaker statement. 

Proposition 2.4. If q is a monic linear pencil, then M^^-^^(g) has the {2d + l)-PosSs- 
property. Its (k, v)-test rank is no greater than ua^{d + 1). 

The proof of Proposition 2.4 will be given in Section 3 below after subsections on pos- 
itive linear functionals on matrix-valued polynomials and on Hankel matrices and the free 
noncommutative moment problem. 

2.4. Positive linear functionals and the GNS construction. Proposition 2.5 below, 
embodies the well known connection, through the Gelfand-Naimark-Segal (GNS) construc- 
tion, between operators and positive linear functionals. 

Given a Hilbert space X and a positive integer u, let A'®'" denote the orthogonal direct 
sum of X with itself u times. Let A be a g-tnple of symmetric i x i matrices, set g = 1 — 
with of the form (2), and abbreviate 

Proposition 2.5. // A : M^^'^(x)2fc+2 — J- M ^s a linear functional which is nonnegative on 
^k+i O'nd positive on T,'^ \ {0}, then there exists a tuple X = {Xi, . . . , Xg) of symmetric 
operators on a Hilbert space X of dimension at most va^{k) = u dim'R{x) k and a vector 
7 G X®" such that 

(6) A(/) = (/(X)7,7) 

for all f G W^" {x)2k+i, where {^,^) is the inner product on X . Further, if X is nonnegative 
on M^+i, then X e^q. 

Conversely, if X = {Xi, . . . , Xg) is a tuple of symmetric operators on a Hilbert space X 
of dimension N, the vector 7 G X®'^, and k is a positive integer, then the linear functional 
A : W''{x)2k+2 K defined by 

A(/) = (/(X)7,7) 

is nonnegative on ^^-^i- Further, if X ^ then A is nonnegative also on Mj^_^^i. 

Proof. First suppose that A : M^^'^ {x)2k+2 — M is nonnegative on S^^-^ and positive on 
\ {0}. Consider the symmetric bilinear form, defined on the vector space K = M.'^^^ (x) k+i 
(row vectors of length v whose entries are polynomials of degree at most k + 1) by 

(7) {f,h) = X{h*f). 
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From the hypotheses, this form is positive semidefinite. 

A standard use of Cauchy-Schwarz inequahty shows that the set of null vectors 

A/':= {/eA'l (/,/) = 0} 

is a vector subspace of K. Whence one can endow the quotient X := K/M with the induced 
positive definite bilinear form making it a Hilbert space. Further, because the form (7) is 
positive definite on the subspace X = W^^{x)k, each equivalence class in that set has a 
unique representative which is a i^-row of polynomials of degree at most k. Hence we can 
consider X as a. subspace of X with dimension Vij^{k). 



Each Xj determines a multiplication operator on X . For / 



G X 



fi 



fu 



e X, let 



and define Xj : X ^ X hj 

X,f = Px,f, feX,l<j<g, 

where P is the orthogonal projection from X onto X (which is only needed on the degree 
k + 1 part of Xjf). From the positive definiteness of the bilinear form (7) on X, one easily 
sees that each Xj is well defined and 

{Xjp, r) = {xjp, r) = {p, xjr) = {p, Xjr) 

for all p,r & X. In particular, each Xj is symmetric. 

Let 7 G X®'^ denote the vector whose j-th entry, 7j has the empty word (the monomial 
1) in the j-th entry and zeros elsewhere. Finally, given words Vg^t G {x)k+i and Ws^t G {x)k 
for 1 < s, t < u, choose / G W^^{x) to have (s, t)-entry w*^Vs^f In particular, with ei, . . . , e,^ 
denoting the standard orthonormal basis for M*^, we have 

V 

s,t=l 

Thus, 

(/(X)7,7) = $^(/s,(X)7t,7s) = J2«A^>sAXhuls) = J2MXhuWs,tiXhs) 
= A(/). 

Since any / G M.'^^'^ {x)2k+i can be written as a linear combination of words of the form w*v 
with w G {x)k+i and f G {x)k as was done above, equation (6) is established. 



12 



HELTON, KLEP, AND MCCULLOUGH 



To prove the further statement, suppose A is nonnegative on M^^-^. Given 

ex®', 

note that 

{{I - ^a{X))p,p) = {p-^AjPxjP,p) = {p-^AjXjP,p) = {{I -^AjXj)p,p) 
= X{p*iI-AAix))p) >0. 
Hence, q{X) = 1 - Aa{X) >z 0. 

The proof of the converse is routine and is not used in the sequel ■ 

Remark 2.6. The proof of Proposition 2.5 follows somewhat the line of a similar result in 
[McCOl, §2]. However, some subtle points are dealt with very explicitly here, since they are 
critical to our perfect Positivstellensatz. One such point worth emphasizing is that we move 
from a functional A, later chosen as a separating linear functional, via the tuple (X, 7), to a 
new linear functional A' : W^^'^{x) — )■ M defined by 

(9) A'(/) = (/(X)7,7). 

Now A' agrees with the original A on M.'^^''{x)2k+i, but they need not agree on monomials of 
degree 2k + 2. 

Equation (8) is the only place where we used that Aa_ has degree one in the context of p 
having degree k. Then / = p*{I — Aa)p has degree at most 2k + 1 and hence, in the notation 
of Remark 2.6, A'(/) = A(/). The delicate gap between 2A; + 2 in the hypotheses and 2k + 1 
in the conclusion of the theorem is what permits us to obtain a perfect Positivstellensatz for 
q of degree 1. Proposition 2.5 and the concomitant careful choice of the quadratic module 
are key ingredients in the proof of Theorem 1.1. 

2.5. Hankel matrices and moment problems. This section is designed to give per- 
spective on Proposition 2.5 and does not contain results essential to the rest of the paper. 
Proposition 2.5 can be interpreted - and proved - in terms of fiat extensions of free non- 
commutative Hankel matrices. 

We say that a linear functional on 'R'^^''{x)2k is positive (nonnegative) if it is positive 
(nonnegative) on \ {0}. If fi : 'R'^^''{x)2k — J- M is a linear functional, then the function 

H : {x)k X {x)k M^^^ H{u, v) = fi{v*u) 

depends only on the product v*u and is called a free noncommutative Hankel matrix. Further, 
fi is positive if and only if H is positive definite in the sense that for any nonzero / : {x)k 



p 



Pi 



Pe 
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we have, 

J2fivrH{u,v)f{u)>0. 

u,v 

The converse is also easily verified; i.e., if the z/ x z/-block matrix H = {H{u,v))u^v£{x)k is 
positive definite and its entries H{u,v) depend only on v*u, then the linear functional 

/i : R'''"'{x)2k ffi, KE ® v*u) := tr{EH{u, v)) 

for words u,v ^ {x)k and E G My^^ , is positive. Furthermore, /i is nonnegative if and only 
if H is positive semidefinite. 

In the case that the restriction a oi ^ : W^'^ {x)2k+i — M to W^^{x)2k — M is positive 
definite, it is easy to check that there is a positive definite A : W^^^ {x)2k+2 — ^ which 
extends /i. The tuple X and vector 7 in A" generated by Proposition 2.5 then determine a 
nonnegative A' : My^'^ (x) — t- M and Hankel matrix defined by 

H{u,v) = X'{v*u) = (i;*m(X)7,7). 

Further, this extension is fiat in the sense that the rank of (the matrix of) H is the same as 
that of the Hankel determined by a and of course A' restricted to W^^''{x)2k — )■ M is /i. 

Finally, this process solves a noncommutative moment problem. Here the view is that 
H = {H{u, v))u^ve(x)^: is a given positive definite Hankel matrix in which case the construction 
just described produces an infinite positive semidefinite Hankel matrix "H extending H. 

The connection between linear functionals and Hankel matrices in this context parallels 
the commutative case, cf. [CF96, CF98, LaslO, Lau09], and was exploited in [McCOl] where 
it was used to represent a given positive definite (noncommutative) Hankel H indexed by 
{x)k with a tuple X. Indeed there the tuple X is constructed by choosing some fiat extension 
H of H to the index set {x)k+i and then constructing the tuple X along the lines of the 
proof of Proposition 2.5. 

A treatment of free noncommutative Hankel matrices is also presented in [PoplO]. There 
the existence of fiat extensions, with necessary hypothesis, of noncommutative Hankel matri- 
ces which are merely positive semidefinite, rather than positive definite is established. This 
article also contains generalizations of the notions of fiat extensions to path algebras and 
connects fiat extensions to sums of squares. 

3. Proof of Theorem 1.1 

As explained above in Subsection 2.3 the proof of Theorem 1.1 will be finished once we 
prove its weaker variant. Proposition 2.4. Thus, throughout q = I — Aa and d are fixed, 
6 = d + 1, and i is the size of A; i.e., A is a gf-tuple of symmetric i x i matrices. Recall that 
M^p = M^p{I - A a) is defined in equation (4). 
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3.1. The truncated quadratic module is closed. Recall, given a natural number k, 

is the vector space of polynomials of degree at most k and its dimension is denoted by 
a#{k). Fix positive integers a, (3 and let n = max{2a, 2/3 + 1}. In particular, the quadratic 
module ^ of equation (4) is a cone in M'^^'^(x)k (recall the degree of g = / — is one). 

Given e > 0, let 

B,{n) := {X e §i I ||X|| < s} and := |J 

There is an £ > such that for all n G N, if X G S^^ and ||X|| < e, then - Aa{X) >z |. 
In particular, C Using this e we norm by 

(10) Ibll :=max{|b(X)|| IXG^J. 

(Let us point out that on the right-hand side of (10) the maximum is attained. This follows 
from the fact that the bounded nc semialgebraic set B^ is convex. We refer to [HM04a, 
Section 2.3] for details). Note that if / G R^''^{x)(s and if ||/*(1 - AAix))f\\ < X^, then 

iir/ii <2iv2. 

Proposition 3.1. The truncated quadratic module M^i^ C W'^''{x)^ is closed. 

Proof. This result is a consequence of Caratheodory's theorem on convex hulls [Ba02, The- 
orem 1.2.3]. Suppose (pn) is a sequence from M^^ which converges to some p G M.'^^''{x) 
of degree at most k. By Caratheodory's theorem, there is an M (at most the dimension of 
M.'^^'^{x)k plus one) such that for each n there exist matrix-valued polynomials r„^j G M^^'^(x)o 
and tn^i G M^^'^(x)/3 such that 

M M 
1=1 i=l 

Since \\pn\\ < X^, it follows that ||r„^j|| < N and likewise j(l — A^(x))t„,i|| < N"^. In view 
of the remarks preceding the proposition, we obtain \\tn,i\\ < \/2N for all i, n. Hence for each 
i, the sequences (r„ j) and (t„^j) are bounded in n. They thus have convergent subsequences. 
Tracking down these subsequential limits finishes the proof. ■ 

3.2. Existence of a positive linear functional. Let 5 = d + 1 and write = M^_^]^^. 
We call a linear functional on 'R''^'^{x)2S positive (nonnegative) if it is positive (nonnegative) 
on \ {0}. 

Lemma 3.2. There exists a positive linear functional X : 'R'^^''{x)2S which is nonnega- 
tive on . 
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Proof. As above, choose 1 > e > satisfying Bs C Select a countable dense subset 

X(i), X(^\ ... of Bs{S) (e.g. all tuples of matrices in B^iS) with rational entries), and define 
A : W''{x)25 ^ K as follows: 

oo ^ 

1=1 

Clearly, X{M^) C M>o. We claim that A is strictly positive on nonzero hermitian squares in 
S^. Let r G 'R'^^''{x)s be arbitrary. If A(r*r) = 0, then by density, r vanishes on B^{6), and 
by nonexistence of low degree polynomial identities (see e.g. [Pro73, Row80]), r = 0. ■ 

3.3. Separation. The final ingredient in the proof of Proposition 2.4 is a Hahn-Banach 
separation argument. Accordingly, let p G M.'^^''{x)2d+i be given with p(Y) >z for all 
Y G We are to show p G M^. 

If the conclusion is false, then by Proposition 3.1 and the Hahn-Banach theorem there is 
a linear functional A : 'R'^^'^{x)2s ^ that is nonnegative on and negative on p. Adding, 
if necessary, a small positive multiple of the linear functional A produced by Lemma 3.2 to 
A, we can assume that A is positive (not just nonnegative) on \ {0}, nonnegative on Mg, 
and still negative on p. But now Proposition 2.5 with k = d applies: there is a tuple of 
symmetric matrices X G acting on a finite-dimensional Hilbert space X and a vector 7 
such that 

A(/) = (/(X)7,7) 
for all / G W^x) 2d+i- In particular, 

(p(X)7,7) = A(j>)<0, 

so that p{X) is not positive semidefinite, contradicting p|(p^ >z and the proof is complete. ■ 

This argument is like the classical one going back to Putinar [Put93] and its noncom- 
mutative version in [HM04a], but with a consequential difference. Possibly the best way to 
view this difference is in terms of the separating functional A. What is new here amounts 
to modifying A to produce a new separating functional A', as in (9). It is this modified 
functional that produces perfection. In other Positivstellensatze, e.g. [HM04a], the proof 
does not do this modification of A and produces a tuple X of bounded selfadjoint operators 
which may act on an infinite-dimensional, rather than finite-dimensional, space and which 
also requires p to be strictly positive on the underlying nc semialgebraic set. 

4. Applications 

We conclude this paper with applications of our main result and the techniques used 
in its proof. First, in Subsection 4.1 we revisit the theme of our paper [HKM-I-], where we 
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discussed how complete positivity is equivalent to LMI domination (i.e., inclusion of LMI 
domains). Here we strengthen some of our previous results by relaxing the assumptions. 
Second, in Subsection 4.2 we give a nonconvex variant of Theorem 1.1 which in turn extends 
the directional Positivstellensatz of [HMP07]. 

4.1. Complete positivity and LMI domination. In this section we assume basic famil- 
iarity with completely positive maps as presented e.g. in [BL04, Pau02, Pis03]. 

Suppose L and L' are monic linear pencils in g variables of size £ and respectively. 
We say that L dominates L' if C '^l'-, i-e., -^v'|fp^ ^ 0. This situation is algebraically 
characterized by our Theorem 1.1. 

Corollary 4.1. L dominates L' if and only if L' E Mq'q(L). Equivalently, L dominates L' 
if and only if there are matrices Vj E M^^^' and a positive semidefinite S E S^/ satisfying 

(11) L'{x) = S + Y,yj*Lix)Vj- 

j 

The following proposition eliminates the need for the positive semidefinite S in Corollary 

4.1 and the (unweighted) sum of squares term in the representation (2) of Theorem 1.1 in the 
case that is bounded. Further, combining this proposition with the argument of Lemma 

2.2 eliminates the need for the (unweighted) sum of squares term in (1) of Theorem 1.1. 

Proposition 4.2. If^L is bounded, then there are matrices Wj E M^^^' such that 

i = J2w;Lix)w,. 

Corollary 4.3 (cf. [HKM+, Theorem 1.1]). Suppose is bounded. Then L dominates L' 
if and only if there are matrices Vi E Mf^^' satisfying 

(12) L'{x) = Y,y:L{x)v,. 

i 

Proof. Factoring S as, S = C*C gives, in the notation of Proposition 4.2, 

S = Y.{W,CrL{x){Wfi). 

j 

An application of Corollary 4.1 then completes the proof. ■ 

Proof of Proposition A.2 . Write L{x) = I — Yl^j AjXj with Aj E M^^^. To show there are 
finitely many, say m, nonzero vectors hk such that ^^(/ifc, hk) = 1 and 

m 

J2{Ajhk,hk) = 

k=l 
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for each j, let §^ denote the unit sphere in and consider the mapping 

S^^M^ {{Ajh,h))j = \{Aih,h) ■■■ {Agh,h) 

If is not in the convex hull of the range of this map, then by the Hahn-Banach theorem 
there is a linear functional A : — > M such that 

X{i{A,h,h))^)>0 

for all h. Let Xj = A(ej), where ei, . . . , is the standard orthonormal basis for M^. Then 

L(tAi, . . . , tXy) = I -tY^ XjAj 

j 

satisfies 

{L{tXi,...,tXg)h,h) = {h,h) -tYXj{Ajh,h) > 

j 

for all t < and all nonzero h, contradicting the boundedness of ^P/,. Hence, is in the 
convex hull which says that the desired hk exist. 

To complete the proof, let Vk^s = hkC*, where ei,...,ei> is the standard orthonormal 
basis for M^'. Thus, Vk^s is the i x i' matrix expressed in terms of its columns as 

Vk,s=[o ■■■ hk ■ ■ ■ 
(where the hk is in the s-th column). Now, 



k,s 



Y {Yl(^k, hk) - J2 ( E^^^-^'^' ^'^)))^ 

s ' 



k 



as desired. 



Remark 4.4. Suppose L dominates L'. In case is not bounded, the positive S* in a 
certificate of the form (11) is needed in general. An expression of the form (12) can be 
achieved for every L' dominated by L if and only if such a representation exists for L' = I. 
As seen in the proof of Proposition 4.2, this is the case if and only if there are vectors h^., 
not all zero, satisfying 

J2{^jhk,hk) = 

k 

for each j. By an old result of Bohnenblust (see [Bon48] for the original reference or [KSll, 
§2.2] for an easier proof of a weaker statement sufficient for our purpose), this happens if 
and only if span({Ai, . . . , Ag}) does not contain a positive definite matrix. 
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Writing L = I — J2 ^j^j and L' = I — J2 ^'j^jy let 

S = span{{I,Ai,...,Ag}) C Se 

be the operator system associated to the monic hnear pencil L, and similarly for S'. The 
approach taken in [HKM+] was to view the inclusion ^ ^l' (under the assumption of 
boundedness of ^l) as saying that the unital mapping 

defined by T{Aj) = A'j is (well-defined) completely positive and then applying the Arveson- 
Stinespring representation theorem [BL04, Pau02, Pis03] for completely positive maps. Since 
the approach in this paper avoids the complete positivity machinery, it is interesting to note 
that Theorem 1.1 implies both the Arveson Extension Theorem and the Stinespring Theorem 
for matrices (as opposed to operators). To see why, suppose S and S' are unital subspaces of 
and E>i' respectively, and t : S ^ S' is unital and completely positive. Choose Ai, . . . ,Ag 
such that {/, Ai, . . . , Ag} is a basis for S. By [KSll, Proposition 4.3.2] the matrices Aj can 
be chosen to make bounded; here L denotes the pencil I — '^AjXj. With A'j = T{Aj), 
the pencil L dominates the pencil L' = I — 'Y^ ^'j^j- Now invoke Theorem 1.1 (for bounded 
domains) to get Arveson's extension as well as Stinespring's theorem. The non-uniqueness of 
this construction is described by simultaneous invertible linear change of variables (on both 
the domain and codomain ^l')- 

4.2. Beyond convexity: a harsher positivity test. The Positivstellensatz in [HM04a] 
assumes the underlying semialgebraic set is bounded, whereas Theorem 1.1 assumes the set 
is convex. In this section we consider a case which lies in between. For simplicity we take 
our polynomials to be scalar-valued. 

Given a finite set S of symmetric noncommutative polynomials whose degrees are at 
most a, let Q = {1 — s*s \ s G S}. We will develop a positivity condition for a polynomial p 
of degree at most 2d equivalent to p lying in the convex cone 

finite 
96Q j 

(Here, and in the rest of this subsection, we omit the superscripts in the notation for quadratic 
modules, since we are dealing only with scalar- valued polynomials.) 

Let X he a finite-dimensional Hilbert space. Given a vector ( ^ X, natural number rj, 
and a tuple X of symmetric operators on X, let denote the subspace 
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of X and ^ be the orthogonal projection of X onto this space. Generically, the dimension 
of 01^ ^ is (J^{ri). The following is a free nonconvex Positivstellensatz with degree bounds. 

Theorem 4.5 (Beyond convex). Letp G M(x)2d he symmetric and fix an integer Q < (5 < d. 
Assume that contains a nontrivial nc neighborhood ofO. If for any Hilhert space X of 
dimension a^{d + a — 1) , any g -tuple of matrices X acting on X and vector C, E X , 

^x,c(l - s*{X)s{X))P^x^^ >z for allseS 

implies 

(p(x)c,C)>o, 

then p G Md+a,i3{Q) ■ {The converse is obviously true.) 

In other words a clean Positivstellensatz holds without concavity of Q (the collection 
S), provided we test positivity of p on a sufficiently large class of matrices and vectors. 

Remark 4.6. 

(1) If a = 1 and (3 = d, then generically dimension counting tells us Ox^^ is X, and we are 
back in the setting of Theorem 1.1. 

(2) The condition: {p{X)(, C) > provided — s*{X)s{X))( > is a condition converted 
to a Positivstellensatz in [HMP07]. The /3 = case of Theorem 4.5 improves this, indeed 
makes a perfect version. 

Sketch of proof of Theorem 4.5. Abbreviate Md+a,i3{Q) to Md+a,i3- Suppose p has degree at 
most 2d, but is not in Md+a,i3- The Proposition 3.1 extends to show Md+a,i3 is closed, with 
an easy generalization of the same argument. Then there is a positive linear functional 
A : M(x)2(d+a) ^ that is nonnegative on M^+a^p but such that X{p) < 0; see Lemma 3.2, a 
variant of which is needed to see that such an A can be chosen positive, not just nonnegative 
on T^d+a \ {0}. Applying Proposition 2.5 produces a finite-dimensional Hilbert space X , a 
tuple of matrices X on X and cyclic vector 7 such that for any polynomial / of degree at 
most 2((i + a) — 1, 

(/(X)7,7) = A(/). 

In this context, the analog of the further part of Proposition 2.5 is the following. If / is of 
degree at most d — 1 and s G S*, then 

((/ - s{Xrs{X))f{X)^, /(X)7> = A(r (J - ss*)f) > 0. 

On the other hand, 

(p(X)7,7) = A(p)<0, 

yielding a contradiction. ■ 
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